[GOBBLIN-2162] Only load added jars in the cache #4062
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Dear Gobblin maintainers,
Please accept this PR. I understand that it will not be reviewed until I have checked off all the steps below!
JIRA
Description
When Gobblin launches a YARN app, if the cache is enabled it will load all the jars stored in the cache into the classpath.
This can be problematic as jars that persisted from older versions of jars or other executions may clobber the classpath, adding jars that are not needed or jars that interfere with the current jars.
This PR ensures that only the jars that were intended to be uploaded by the GobblinYarnAppLauncher are the only jars that are loaded into the classpath from the shared cache.
Tests
Commits